EPJ manuscript No. 

(will be inserted by the editor) 



o: 
o. 

(N 

o Lynden-Bell and Tsallis distributions for the HMF model 

<D ■ 
Q ! P.H. Chavanis 

>0 , Laboratoire de Physique Theorique, Universite Paul Sabatier, 118 route de Narbonne 31062 Toulouse, France 
e-mail: chavanisOirsamc . ups-tlse . f r 

O ' To be included later 

<D ; 

Abstract. Systems with long-range interactions can reach a Quasi Stationary State (QSS) as a result of 

a violent collisionless relaxation. If the system mixes well (ergodicity), the QSS can be predicted by the 

statistical theory of Lynden-Bell (1967) based on the Vlasov equation. When the initial condition takes 

only two values, the Lynden-Bell distribution is similar to the Fermi-Dirac statistics. Such distributions 

have recently been observed in direct numerical simulations of the HMF model (Antoniazzi et al. 2006). In 

this paper, we determine the caloric curve corresponding to the Lynden-Bell statistics in relation with the 

HMF model and analyze the dynamical and thermodynamical stability of spatially homogeneous solutions 

by using two general criteria previously introduced in the literature. We express the critical energy and 

the critical temperature as a function of a degeneracy parameter fixed by the initial condition. Below these 

critical values, the homogeneous Lynden-Bell distribution is not a maximum entropy state but an unstable 

saddle point. Known stability criteria corresponding to the Maxwellian distribution and the water-bag 

O , distribution are recovered as particular limits of our study. In addition, we find a critical point below 

which the homogeneous Lynden-Bell distribution is always stable. We apply these results to the situation 

-ys ' considered in Antoniazzi et al. For a given energy, we find a critical initial magnetization above which the 

homogeneous Lynden-Bell distribution ceases to be a maximum entropy state. For an energy U — 0.69, 

■^l- . this transition occurs above an initial magnetization M x — 0.897. In that case, the system should reach an 

r-f-\ ' inhomogeneous Lynden-Bell distribution (most mixed) or an incompletely mixed state (possibly fitted by 

£SJ , a Tsallis distribution). Thus, our theoretical study proves that the dynamics is different for small and large 

initial magnetizations, in agreement with numerical results of Pluchino et al. (2004). This new dynamical 

phase transition may reconcile the two communities by showing that they study different regimes. 

^^ ■ PACS. 05.45.-a Nonlinear dynamics and nonlinear dynamical systems 

ctf ; 

Ch ' 1 Introduction number of particles so that the QSS has a very long life- 

1 , \ time which becomes infinite in a proper thermodynamic 

£^ ' The dynamics and thermodynamics of systems with long- nmlt JV ~^ +oo. 

range interactions is a topic of active research 0. Ex- The nature of the Q SS has created an intense debate 

amples include self-gravitating systems, two-dimensional m the statistical mechanics community. Two d ifferent ap- 

> ! vortices, neutral and non-neutral plasmas, chemotaxis of Peaches have been developed. Some authors [6J8115J in- 

•-H . bacterial populations, just to mention a few. In addition s P lred b y the work of Tsalhs EH hav e proposed to in- 

X ■ to these physical systems, a toy model called the Hamil- terprete these QSS in terms of a non-extensive thermody- 

b tonian Mean Field (HMF) model is widely studied [2-21] namics based on the so-called g-entropy which is ageneral 

■ - - ■ because it displays many features of more realistic sys- nation of the Boltzmann entropy. O ther au thors |9 | 12 | 25 | 2u| 

terns with long-range interactions, like gravity, while being aspired by the work of Lynden-Bell |27J22j m astrophysics, 

amenable to a simpler mathematical treatment [12] . have Prosed to mterprete these QSS in terms of a statis- 

The HMF model is known to display two successive tlcal mechanics of the Vlasov equation called the theory of 

types of relaxation, like for stellar systems and two di- vlolent 1 relaxation LJ. The idea of Lynden-Bell is to deter- 

mensional vortices [22155] . The first stage of the dynamics mine the most probable state of the system resulting from 
is a violent collisionless relaxation leading to a QSS after a l This theory is relati vely well-known in astrophysics and 

few dynamical times. This QSS is in general different from 2 D turbulence [27l28l22] but it took some time to diffuse in 

the Boltzmann distribution. The second stage is a slow t he statistical mechanics community despite several efforts of 

"collisional" relaxation (due to granularities and finite N the author to publicize it [29130122125] , In particular, the pos- 

effects) leading to the Boltzmann distribution which is sibility to apply the Lynden-Bell theory to the HMF model 

the statistical equilibrium state of the system. The "col- (but also the limitations of its application) was mentioned in 

lisional" relaxation time increases algebraically with the several papers [12125131] . 
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phase mixing compatible with all the constraints imposed 
by the Vlasov dynamics. This assumes that the system 
mixes well so that a hypothesis of ergodicity is made. If 
the initial distribution takes only two values, Lynden-Bell 
predicts at meta-equilibrium a coarse-grained distribution 
similar to the Fermi-Dirac statistics in quantum mechan- 
ics |27|28|32] , In a recent paper, Antoniazzi et al. 26J have 
performed direct numerical simulations of the HMF model 
and found situations in which the Lynden-Bell distribu- 
tion provides a good description of the QSS without ad 
hoc fitting parameter. These numerical results are a good 
motivation to investigate these distributions in more de- 
tail, as done in this paper. 

In Sec. [2l we briefly recall the Lynden-Bell theory of 
violent relaxation with notations appropriate to the HMF 
model. A more thorough description of this theory can be 
found in the classical paper [27] and in [2813 31 . In Sec. 
we determine the equation of state p(p) associated with 
the Lynden-Bell distribution f(8, v). We consider two par- 
ticular limits: the dilute limit where the Lynden-Bell dis- 
tribution becomes similar to the Maxwell-Boltzmann dis- 
tribution and the completely degenerate limit where the 
Lynden-Bell distribution becomes a step function (water- 
bag) similar to the Fermi distribution in quantum mechan- 
ics. In Sec. HI we determine the caloric curve /3(E) cor- 
responding to the Lynden-Bell statistics in relation with 
the HMF model. We restrict ourselves to spatially homo- 
geneous distributions. In Sec. [5] we analyze the dynami- 
cal and thermodynamical stability of these homogeneous 
solutions by using two general criteria previously intro- 
duced in the literature: one is based on the distribution 
function of the system [9] and the other on the velocity 
of sound c s = p'{p) in the corresponding barotropic gas 
|12j . These criteria are equivalent. We express the criti- 
cal energy and the critical temperature as a function of 
a degeneracy parameter p fixed by the initial condition. 
The known stability criteria corresponding to the Maxwell 
distribution and the water-bag distribution |9|12j are re- 
covered as particular cases of our study since these distri- 
butions are two limits of the Lynden-Bell distribution. For 
E < E c (p) or T < T c (p) the homogeneous Lynden-Bell 
distribution is not a maximum entropy state. Therefore, 
it is not expected to be achieved as a result of violent 
relaxation. In that case, the system may reach an inho- 
mogeneous Lynden-Bell distribution (if it mixes well), or 
another distribution (if it does not mix well). A critical 
point /u* = 0.68786... is found below which the homoge- 
neous phase is always stable whatever the value of energy 
and temperature. In Sec. [6l we apply our results to the 
situation considered in Antoniazzi et al. [26]. For a given 
energy, we find a critical initial magnetization above which 
the homogeneous Lynden-Bell distribution ceases to be 
a maximum entropy state and becomes a saddle point. 
For an energy U = 0.69, this transition occurs above an 
initial magnetization M x = 0.897. For M x > 0.897, the 
system should reach an inhomogeneous Lynden-Bell dis- 
tribution (most mixed state) or an incompletely mixed 
state (possibly spatially homogeneous). Thus, our theo- 
retical study proves that the dynamics is radically differ- 



ent for small and large initial magnetizations. This tends 
to corroborate the claim of Pulchino et al [8] who made 
a similar observation on the basis of numerical simula- 
tions. In the Conclusion, we stress the limitations of the 
Lynden-Bell theory and the possibility that the QSS can 
be described by other types of distributions when the sys- 
tem does not mix well (incomplete violent relaxation) . In- 
deed, the Vlasov equation admits an infinite number of 
steady states and the system can be trapped in one of 
them during the collisionless dynamics |25 . The Tsallis 
distributions (corresponding to stellar polytropes in astro- 
physics) are particular stationary solutions of the Vlasov 
equation which can sometimes provide a good fit of the 
QSS in case of incomplete relaxation [6]. However, there 
is no fundamental reason why these distributions should 
always (universally) be selected by the dynamics and, in- 
deed, many other distributions can emerge in case of in- 
complete relaxation, depending on the initial conditions, 
on the value of the control parameters, and on the route 
to equilibrium [25j . The Tsallis distributions form just a 
one-parameter family of steady states of the Vlasov equa- 
tion [33J and there is no theoretical justification of using 
them unless one invokes their simplicity and popularity. 
Similarly, stellar polytropes in astrophysics represent fa- 
mous stationary solutions of the Vlasov-Poisson system 
that can provide simple mathematical models of galaxies 
or convenient fits of astrophysical systems in certain cases, 
but other distributions can also be considered [34]. In fact, 
real galaxies are not described by polytropic (or Tsallis) 
distributions [35 2]5] . 



2 Theory of violent relaxation for the HMF 
model 

The HMF model is a system of N particles moving on a 
circle and interacting via a cosine binary potential, e.g. 
[5I12J . The dynamics of these particles is governed by the 
Hamilton equations 



dt 

N 



8H 

dvi' 



~dt 



8H 



H 



8=1 ijtj 
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This system has an unusual thermodynamic limit defined 
by N -> +oo with e = 8nE/kM 2 and r] = kM/4nT fixed 
(here M — Nm is the total mass and we have taken 
m = 1). We can rescale the parameters of the problem 
so that the coupling constant scales like k ~ 1/N while 
E ~ N and T ~ 1 [23]. For N -> +oo in this proper ther- 
modynamic limit, the evolution of the distribution func- 
tion (DF) is governed by the Vlasov equation [9|12|23j : 



8£ dl_d±dl = r ) 
dt 89 89 dv 
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Starting from an unstable initial DF fo(9,v), the Vlasov 
equation coupled to the meanfield potential (J3j> gener- 
ates a complicated mixing process at the end of which 
the coarse- grained DF f(9, v, t) achieves a quasi-stationary 
state fossi^i v )- If the system mixes wellQ the QSS is de- 
scribed by the Lynden-Bell distribution [27|22|25j . If the 
initial DF takes only two values /o = ?7o and / = 0, the 
QSS predicted by Lynden-Bell is obtained by maximizing 
the mixing entropy [3U] : 
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where p = J fdv is the spatial density. We thus have to 
solve the optimization problem 

Max{5[/] | E[J]=E,M[J]=M}. (7) 

Writing the first order variations as 

SS - [38E - aSM = (8) 

where (3 — 1/T and a are Lagrange multipliers, one ob- 
tains the Lynden-Bell distribution function 



/ = 



Vo 



1 + Ae«^+^» 



(9) 



where A = e a > plays the role of a fugacity. Morpho- 
logically, this distribution function is similar to the Fermi- 
Dirac statistics [27 28 32 so that we shall find many analo- 
gies with quantum mechanics. 

The Lynden-Bell functional (f4|) is an entropy because 
it is proportional to the logarithm of the disorder, where 
the disorder is equal to the number of microstates con- 
sistent with a given macrostate. Indeed, the Lynden-Bell 
entropy is obtained from a combinatorial analysis |27|31j . 
Therefore, its maximization at fixed mass and energy de- 
termines the most probable macrostate, i.e. the one that 



2 Lynden-Bell |27| introduces the notion of microstates 
corresponding to the finely striated structure of the DF 
and macrostates corresponding to the smoothed-out (coarse- 
grained) DF. Using the standard postulate of statistical me- 
chanics, he assumes that all the accessible microstates (with 
the right value of the integral constraints) are equiprobable. 
Therefore, if the system "mixes well" , it will be found at meta- 
equilibrium in the macrostate which is represented by the max- 
imal number of microstates. This most probable (most mixed) 
macrostate is obtained by maximizing the Lynden-Bell mixing 
entropy under all the constraints of the Vlasov equation [31] . 



is the most represented at the microscopic (fine-grained) 
scale. In this sense, the optimization problem (fTJ) is a con- 
dition of thermodynamical stability for the collisionless re- 
laxation. Alternatively, the Lynden-Bell functional ((4]) can 
also be intepreted as a particular iJ-function in the sense 
of Tremaine et al. [36] • Indeed, it is of the form 



S=- I C(f)d9dv, 



(10) 



where C is convex. In that context, the optimization prob- 
lem ([7]) is a condition of formal nonlinear dynamical sta- 
bility with respect to the Vlasov equation }36 9 12 3 7138) . 
Therefore, the maximization of S at fixed E and M guar- 
antees that the statistical equilibrium macrostate is sta- 
ble with respect to the perturbation on the microscopic 
scale (thermodynamical stability) and that the coarse- 
grained DF / is stable for the Vlasov equation with re- 
spect to macroscopic perturbations (nonlinear dynamical 
stability) . 

We emphasize that it is only when the initial DF takes 
two values rjo and that the Lynden-Bell entropy can be 
expressed in terms of the coarse-grained DF / as in Eq. 
(fJJ . In general, the Lynden-Bell entropy is a functional of 
the probability distribution of phase levels p(9,v,rj) of the 
form: 



Slb[p] 



plnpdOdvdrj, 



(11) 



and the coarse-grained DF is given by / = J prjdr] [27128131(23] . 
The general Lynden-Bell distribution is expressed as a su- 
perposition of Fermi-Dirac distributions of the form 



/ = 



Jx(v)ve~ v{l3e+a) dr] 
fx(v)e~ ri< ' l3e+a)dr l ' 



(12) 



where we have noted e = v 2 /2 + $(9) the energy per par- 
ticle. This is similar to a sort of superstatistics [31] where 
the function x(v) is determined indirectly by the initial 
condition. Therefore, the expression (fj| of the collisionless 
entropy is not universal; it is valid only in the two-levels 
approximation. We note also that the expression of the 
collisionless entropy given by [TJ] is not correct. These au- 
thors do not introduce the notion of coarse-graining and 
phase mixing, nor the local distribution of phase levels 
p(6,v,rj), which is capital in the theory of violent relax- 
ation to describe the QSS [27] . The correct form of entropy 
for the violent relaxation process (based on the Vlasov 
equation) is the Lynden-Bell entropy (fTTj) as claimed in 

It should be stressed that the theory of violent relax- 
ation is valid for many systems with long-range interac- 
tions described by the Vlasov equation, not only for the 
HMF model [23]. Historically, this theory was first intro- 
duced in astrophysics for collisionless stellar systems |27| . 
The calculation of self-gravitating Fermi-Dirac spheres cor- 
responding to the Lynden-Bell distribution was performed 
in [32] and the caloric curve /3(E) was obtained as a func- 
tion of a degeneracy parameter p. An equivalent theory of 
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violent relaxation was developed in two-dimensional tur- 
bulence described by the 2D Euler equation to account for 
the structure and robustness of large-scale vortices such as 
Jupiter's great red spot |39|40j . The analogy between 2D 
vortices and stellar systems was discussed in [29I28I22J . 
Many numerical simulations have been performed in the 
two domains to test the successes and the failures of the 
Lynden-Bell prediction (see [55] for some references) . The 
limitations of the Lynden-Bell theory will be discussed in 
the Conclusion. In the following, we shall assume that the 
QSS is described by the Lynden-Bell distribution (statisti- 
cal equilibrium state of the Vlasov equation) and we use a 
presentation similar to that developed in the gravitational 
context l32l. 



3 Properties of the Lynden-Bell distribution 

In this section, we discuss some properties of the Lynden- 
Bell distribution ([9]) and consider two limit forms of this 
distribution: the Maxwell-Boltzmann distribution obtained 
in the non-degenerate limit and the Fermi distribution 
(water-bag) obtained in the completely degenerate limit. 



3.2 The dilute limit (Maxwell-Boltzmann distribution) 

In the limit A — > +00, the Lynden-Bell distribution re- 
duces to the Maxwell-Boltzmann distribution 



y~ Vlp-Pi^+no)) 



A 



(18) 



Since / <C 770, this corresponds to a dilute limit (or to a 
non degenerate limit if we use the terminology of quan- 
tum mechanics). In this limit, the Lynden-Bell entropy ((4]) 
takes a form similar to the Boltzmann entropy 
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LB 
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— In — dOdv. 



(19) 



The corresponding equation of state is that of an isother- 
mal gas 

P = pT. (20) 

This result can be obtained directly from Eqs. (p~5|) - (p~6|) 
by using the asymptotic expression of the Fermi-Dirac in- 
tegrals for t — ► +00: 



In(t) 



t 



(n>-l). 



(21) 



3.1 The equation of state 

To any distribution function / = /(e) depending only on 
the energy e = v 2 /2+<I>(9), one can associate a correspond- 
ing barotropic equation of state p(p) [T2]. The density and 
the pressure are defined by 



+00 



fdv, 



+ OC 



fv dv. 



(13) 



(14) 



Let us determine the equation of state associated with 
the Lynden-Bell distribution @. Substituting for / from 
Eq. © to Eqs. ([T3 ]) -([Hj ) . introducing the notation A(9) = 
\ e /3*( e ) ; anc i performing the change of variables x = (3v 2 /2, 
we obtain 







1/2 
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where we have defined the Fermi integrals 



In{t) 



+ OG 



l + te x 



-dx. 
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By eliminating A between Eq. ([15]) and Eq. (|16p . we see 
that the equation of state is barotropic, i.e. the pressure 
is a function p(p) of the density. It is equivalent to the 
equation of state of an ideal Fermi gas in one dimension. 



3.3 The degenerate limit (water-bag distribution) 

In the limit A — v 0, the Lynden-Bell distribution © re- 
duces to the Heavisidc function 



where 



(v < v F ), 

(v > V F ), 



v F (9) = v/-(2//3)lnyl(0), 



(22) 



(23) 



is a maximum velocity. The distribution (|22[) is often called 
the water-bag distribution. It is also similar to the Fermi 
distribution in quantum mechanics and v F is similar to 
the Fermi velocity. Thus, the limit A — ► corresponds to 
a completely degenerate limit in the quantum mechanics 
terminology. 

Using Eqs. (fl"3l) - (fl"4]) . the density is given by p = 2rj v F 
and the pressure by p — (2/3)t]qv f . Eliminating v F be- 
tween these two expressions, we find that the equation of 
state is 



1 



P 



12/75' 



(24) 



This is similar to the equation of state of a polytrope 
p = Kp l+l ' n with an index n = 1/2 and a polytropic 
constant K = 1/(12?7q). Polytropic distributions (related 
to Tsallis distributions) have been studied in [12] in re- 
lation with the HMF model. The equation of state (f2"4"]l 
can also be obtained directly from Eqs. (fT5"]) - (fll)]) by using 
the asymptotic expression of the Fermi-Dirac integrals for 
i-cO: 



In{t) 



(-lnt) n+1 



(n> -1). 



(25) 
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Fig. 1. Inverse temperature 77 as a function of the fugacity A. 

4 The caloric curve 

From now on, we restrict ourselves to spatially homoge- 
neous systems (# = 0) so that the Lynden-Bell distribu- 
tion becomes 



/ 



no 



1 + Ae^ 



(26) 



Fig. 2. Energy e as a function of the fugacity A. 

In terms of the pressure (|14jl , this can be written 

E = up. 
Introducing the dimensionless energy [12j : 

8nE 



kM 2 ' 1 



In this section, we shall determine the relation between the 
temperature T and the energy E. This defines the caloric 
curve T(E). Note that the temperature T is a Lagrange 
multiplier associated with the conservation of energy in 
the variational problem © . It also has the interpretation 
of a kinetic temperature in the Fermi-Dirac distribution 

©■ 

It is useful to introduce dimensionless quantities as in 
[T2"] . We define the dimensionless inverse temperature by 



and using Eq. ((T 



we get 
2fi 
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Using Eq. (|29|) . the foregoing equation can be rewritten 
_ 2 I 1/2 (A) 
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We also introduce the degeneracy parameter 



(jt = m 



2irk 
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The function e(A) increases (see Fig. [2]). It starts from 
e(0) = 1/(6/j 2 ) and increases like e(A) ~ A 2 /(tth 2 ) for 
A — ► +00. Therefore, 



e > Cn 



1 



(35) 



These notations are similar to those used in the astro- 
physical context [32] . Using Eq. Jl3|) and p = M/(2ir) for 
a homogeneous system, we find that the parameter A (fu- 
gacity) is related to the temperature and to the degeneracy 
parameter by 



This minimum energy is similar to the ground state of a 
one dimensional Fermi gas. In terms of dimensional vari- 
ables it is given by 



E n 



v = [i 2 I_ 1/2 (Af 



(29) 



M 3 
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The curve r)(A) is decreasing. It behaves as 77 ~ — 4/i 2 ]nA 
for A — * and as 77 ~ tt^ 2 /A 2 for yl —> +00 (see Fig. [T|). 

For a homogeneous system, the energy is simply the 
kinetic energy 



The caloric curve (3{E), or equivalently i](e), is ob- 
tained by eliminating A between Eqs. (|29|) and (|34|) . We 
note that the relation between r\j p? and e/z 2 is indepen- 
dent on the degeneracy parameter fi. For A — * +00, we 
recover the relation 
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Fig. 3. Caloric curve corresponding to the spatially homoge- 
neous Lynden-Bell distribution. 



valid for a classical isothermal gas described by the Maxwell- 
Boltzmann distribution (I18| [12] • In terms of dimensional 
variables, the relation ([57)) can be written 



E 



1 



-MT, 



(E^+oo). 



(38) 



To investigate the behaviour of the caloric curve close to 
the ground state, we use the Sommerfeld expansion of the 
Fermi integrals for t — ► 0: 

h /2 (t) = \{-\ntf 2 (l + £(- In r 2 + -), (39) 



I_ 1/2 (i)=2(-ln*Wl_ZL(_ m *)-2 + .,.). NO) 



5 Stability of the homogeneous phase 

We have seen that the optimization problem (Jjj provides a 
condition of thermodynamical stability (in Lynden-Bell's 
sense) and a condition of nonlinear dynamical stability 
with respect to the Vlasov equation. We thus have to select 
the maximum of S at fixed E, M . Indeed, a saddle point 
of S is unstable and cannot be obtained as a result of 
a violent relaxation. It can be shown that, for the HMF 
model, the optimization problem ((Jj is equivalent to the 
optimization problem 

Mm{F[J} = E[J}-TS[J] \ Mtf\=M}, (43) 

where F can be interpreted as a free energy. The crite- 
rion J7J can be viewed as a criterion of microcanonical 
stability and the criterion (|43p as a criterion of canonical 
stability. For the HMF model, the statistical ensembles 
(microcanonical and canonical) are equivalent so that all 
the stable solutions can be constructed from the simpler 
optimization problem (|4"3"]l ; no stable solution is forgotten 
if we solve (|4*3"]l instead of (J7J. Now, the optimization prob- 
lem (|4"3"|) has been studied in [9I12J for general functionals 
of the form (fT0|) and a simple stability criterion has been 
obtained in the case where the steady state is spatially ho- 
mogeneous. The stability criterion can be expressed either 
in terms of the distribution function [9] or in terms of the 
velocity of sound in the corresponding barotropic gas |12j . 
In this section, we apply these criteria to the Lynden-Bell 
distribution (l26l). 



Combining these results with Eqs. 



(f3"4"|) . we obtain 
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In terms of dimensional variables, this relation can be 

written 



E — E. n 



36 V E, 



MT 



(42) 



We note that the energy does not vanish for T = 0. This 
is similar to the effect of a quantum pressure in quantum 
mechanics, i.e. the distribution function (|26|) is not a Dirac 
peak MS(v) for T = {). 

The caloric curve 77(e) is represented in Fig. [3] It is 
parameterized by A. We note that the dilute limit A —+ 
+00 corresponds to £ -> +00 and the degenerate limit 
A — > corresponds to e — » e m j n . 



5.1 Criterion based on the velocity of sound 

It is shown in [12] that the stability criterion (j43f for a 
spatially homogeneous solution of the Vlasov equation can 
be put in the form of a condition on the velocity of sound 
c? s = p'(p) in the corresponding barotropic gas. A spa- 
tially homogeneous distribution is stable with respect to 
the Vlasov equation (in the above sense) if, and only, if 



c?> 



kM 

47T 



(44) 



This stability criterion exploits the subtle correspondance 
between a kinetic system described by a DF / = /(e) 
and a barotropic gas with an equation of state p(p). This 
correspondance is related to the Antonov first law in as- 
trophysics (see [12138] for details). 

Let us now apply this criterion to the Lynden-Bell dis- 
tribution. From Eqs. (|15[) - (fll)|) , we get 



2 r 1/2 (A) 



p {p) = PlUM 



Now, using the identity 



we obtain 
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Fig. 4. Graphical construction determining the critical value 
of the fugacity A c below which the homogeneous Lynden-Bell 
distribution is not a maximum entropy state anymore. For fj, > 
/i c there is only one intersection. 



In terms of the dimensionless parameters, the stability 
criterion (I44I1 can be written 



V— ~^~ < 1, 



I-1/2(A) 



where A is given by 



I-i/2(A) 



Vv 

) 



according to Eq. (|29p. Combining Eqs 
rewrite the stability criterion in the form 



d>(A) ee I_ 1/2 (A)A\I'_ 1/2 (A)\ < -■ 

A* 



(48) 



(49) 



(50) 



Fig. 5. Graphical construction determining the critical val- 
ues of the fugacity A c at which the homogeneous Lynden- 
Bell distribution ceases to be a maximum entropy state. For 
p* < H < He there are two intersections. The homogeneous 
distribution is stable (entropy maximum) for A < A c and 
A>A?\ 

the equation <j>{A) — l//x 2 has only one solution denoted 
A c (see Fig. HJ. The condition of stability of the homoge- 
nous phase corresponds to A > A c . In terms of the tem- 
perature (|29|) or the energy (j34|) , the condition of stability 
of the homogeneous phase can be written 



r)<r)c{lJ), e>e c (^), 



(54) 



where the critical temperature and the critical energy are 
defined by the parametric equations 



AJ_ 1/2 (A C )\I'_ 1/2 (A C ) 

I-1/2(A C ) 



1 



The function 4>{A) starts from 0(0) = 2. It first increases 
Iike</>(yl) = 2+(7r 2 /6)(— lnyl) -2 for A — ► 0, reaches a max- 
imum at (A* = 0.024, <f>* = 2.1135) and then decreases like 
<j)(A) — 7r/yl 2 for A — ► +oo (see Figs.g][S]). Therefore, there 
exists a critical point in the problem. If 



Vc 



AM 1 



1/2 



{Ac)[ 



2 AM' 



1-1/2 (A c ) 



2— h/2(A c ) 



fj,< n* 



0.68786, 



(51) 



the homogeneous system is stable for any temperature and 
any energy. In terms of dimensional quantities, this corre- 
sponds to 



T)Q < fl* 



M 

2nk 



1/2 



(52) 



Alternatively, for [i > /i* the homogeneous Lynden-Bell 
distribution is not always a maximum entropy state. 
For fj, > fx c , where 



where we recall that 

I-l/2(t) = 

1-1/2$) = - 
h/2(t) = 



4-oo 



y/x(l+te x )"" 

e x 


yfx(l + te x ) 2 
^ dx. 



dx, 



dx. 



l + te x 



(55) 
(56) 

(57) 

(58) 
(59) 
(60) 



He 



1 

V2 



0.70710, 



(53) 



For h* < [i < /i c , the equation 4>(A) = l//i 2 has two 
solutions denoted A c and A c (see Fig. [5]). The homo- 
geneous phase is stable for A < A c and for A > A c . In 
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Fig. 6. Stability diagram of the homogeneous phase in the 
(n, rj) plane. 
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Fig. 7. Stability diagram of the homogeneous phase in the 
((j,, e) plane. 



terms of the temperature, the condition of stability of the 
homogeneous distribution can be written 



v<vi 2) (p) 



v^rtHn), 



(61) 



S 1 ), 



.,(2) 



(1) 



where r) c (fi) and t] c (/x) are given by Eq. (|56p with A 

(2) 

and A c respectively. In terms of the energy, the condition 
of stability of the homogeneous distribution can be written 

e>4 2) (M) or e min O)<e<e«0), (62) 



.(!)/ 



.( 2 ) 



(i) 



where e c (/i) and e c (/j) are given by Eq. (|5rj|) with A 
and A c ' respectively. 

The stability diagram of the homogeneous Lynden-Bell 
distribution (f2"6"|) is plotted in Figs. __][__ in the (/J, 77) plane 
and in the (/i, e) plane respectively. The representative 
curve rjc(fi) or e c (/x) marks the separation between the 




Fig. 8. Caloric curve (|29[) - (|34[) corresponding to the homoge- 
neous Lynden-Bell distribution for different values of the de- 
generacy parameter fi. We have indicated the point (e c ,rj c ) at 
which the series of equilibria becomes unstable. These points 
are related to each other by the dashed line (e c (M) — ??c(/x)) 
parameterized by /j,. It is obtained from Eqs. (|56|) - (|57|) . For 
jj, > jj, c there is only one intersection between the caloric curve 
and the dashed line. For p,* < /j, < /j, c there are two intersec- 
tions (see Fig. [9j • For /j, < (i* there is no intersection and the 
homogeneous phase is always stable. 
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Fig. 9. Enlargement of the previous diagram to show the par- 
ticularity of the interval /i, < fj, < fi c . When /1 lies in this 
interval (specifically we have taken /1 = 0.695) there exists two 
zones of stability in the series of equilibria separated by a zone 
of instability. 



stable (maximum entropy states) and the unstable (sad- 
dles point of entropy) regions. We have also plotted the 
minimum accessible energy e m i n (fi). In Figs.[5][51 we have 
represented the caloric curve 77(e) for different values of the 
degeneracy parameter and we have indicated the point at 
which the series of equilibria becomes unstable (for suffi- 
ciently small values of e or sufficiently large values of rj) . 
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Here, the term "unstable" means that the homogeneous 
Lynden-Bell distribution is not a maximum entropy state, 
i.e. (i) it is not the most mixed state (ii) it is dynami- 
cally unstable with respect to the Vlasov equation. As a 
result, it should not be reached as a result of violent re- 
laxation. One possibility is that the system converges to 
the spatially inhomogeneous Lynden-Bell distribution ((9|) 
with <P =/= which is the maximum entropy state (most 
mixed) in that case (see Sec. [6]). Another possibility, al- 
ways to consider, is that the system does not converge 
towards the maximum entropy state, i.e. the relaxation is 
incomplete (see Sec. [6] and the Conclusion). 

5.2 Limit cases 

In the non-degenerate limit A c — ► +oo, using the asymp- 
totic expansion (f2"Tj) . we find that 



'lr 



1. 



1- 



/" 



Ac/Vn- 



(63) 



These results are valid for /i — v +oo. In terms of dimen- 
sional variables, the condition of stability can be rewritten 



T> 



kM 

47T 



T B 



E> 



kM 2 
~8^~ 



E r , 



(64) 



This returns the well-known nonlinear dynamical stabil- 
ity criterion (with respect to the Vlasov equation) of a 
homogeneous system with Maxwellian distribution func- 
tion (see, e.g., |9I12| ). Indeed, for the equation of state 
(|20|) , the velocity of sound is c 2 — T and the stability cri- 
terion (|44|) directly leads to Eq. (|64|) . This also coincides 
with the ordinary thermodynamical stability criterion ap- 
plying to the collisional regime, for t —* +oo, where the 
statistical equilibrium state is the Boltzmann distribution 
for / (without the bar!). 

In the completely degenerate limit A c — > 0, using the 
asymptotic expansion (|25p . we find that 



>k 



+00, 



/' 



1 



(65) 



This can be interpreted in terms of the water-bag model 
described by the DF ([22)). For the equation of state (f24|) , 
the velocity of sound is c 2 s = p 2 /(4j] 2 ) = M 2 /(167r 2 ?7 2 ) and 
the stability criterion (|55j) gives 



'/() 



< 



\4nkJ 



1/2 



i-e- M < -t=- (66) 



Note, parenthetically, that this criterion can also be writ- 
ten as a condition on the Fermi velocity [T5]: v 2 F > fcM/(47r) 
since c s — vf according to the relations of Sec. 13.31 For 
any value of p, the Fermi distribution is valid for the en- 
ergy e = e m i n = l/(6/x 2 ) corresponding to A — > (ground 
state). According to the criterion (f6"6"]) . it is stable only for 
fj. < [i c = l/\/2, i-e 



1 
> -. 
- 3 



(67) 



This returns the well-known stability criterion for the water- 
bag model (see, e.g., |9|12j ). 



5.3 Criterion based on the distribution function 

As shown in [9] , the stability criterion associated with the 
optimization problem (|43[) can be written in terms of the 
distribution function as 



-I 



+ 00 



/» 



dv < 0. 



(68) 



The equivalence with the criterion (|55j) is proved in |12j . 
The criterion (f6"5)) can also be obtained by investigating 
the linear dynamical stability of a homogeneous solution 
of the Vlasov equation [3|7|12j . Substituting Eq. (J2BJ) in 
Eq. (|68p . we find that a homogeneous system described by 
the Lynden-Bell distribution is stable if and only if 



1 - krjoA 



ft 



1/2 



y/x{l + Ae x ) 2 



dx > 0. (69) 



This condition is equivalent to Eq. (|4"5)l . as it should, so 
that the previous stability analysis could have been per- 
formed without modification by starting directly from Eq. 

We may note at this place that the notations intro- 
duced in this paper and in [12j differ from those usually 
introduced in the HMF literature, e.g. [9]. This is because 
we tried to draw a close parallel with the notations intro- 
duced in astrophysics, e.g. [51]. However, it is not difficult 
to find the relation between the two sets of parameters. In 
particular, we have 



°-\ 



ft 

71= r 



(70) 



where U and ft are the energy and the inverse temperature 
used in [5] (note that we prefer using dimensionless pa- 
rameters constructed with all the dimensional quantities 
of the problem instead of fixing some of them to specific 
values). Therefore, our critical values (e c ,r) c ) — (1,1) for 
the Maxwell distribution correspond to (U c , ft c ) = (3/4, 2) 
and our critical energy e c = 1/3 for the water-bag distri- 
bution corresponds to U c = 7/12, in agreement with [9]. 
Note furthermore that, within our notations, the stability 
criterion for polytropes (Tsallis distributions) takes a very 
neat form (see Eq. (156) in [i"2]). 



6 Application 

For illustration, let us apply our results to the numerical 
study of [26]. We consider an initial condition made of 
a patch of uniform distribution function /o = 7?o in the 
interval (-nA9 <9< nA6, -Av <v< Av) and / = 
outside (water-bag). The density is p = 2i]qAv and the 
total mass is 



M = ri 4:irAvA9. 



(71) 



The energy of a distribution which is symmetric with re- 
spect to 6 = is given by 



E = 



1 



fv 2 d6dv 



nB 2 



(72) 
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where 



B 



2Wo 



p{9) cos 9d9, 



(73) 



is a parameter similar to the magnetization in spin systems 
[12] . For the water-bag initial condition /o, the kinetic 
energy is given by 



K = -Trr l0 A9(Av) 3 , 



and the magnetization by 

2A- 



Bq = rjoAvsm(jrA8). 

7T 



(74) 



(75) 



It is convenient to introduce the dimensionless parameters 

1/2 



x = ttA9, y = Av 



irkM 



& = "W (?6) 



Then, the dimensionless initial magnetization can be writ- 
ten 



b = 



sin a; 



the dimensionless energy 



— y 2 -2b 2 . 
6 y 



and the degeneracy parameter 



//,: 



1 

xy' 



(77) 



(78) 



(79) 



For a given energy e, the previous relations relate the ini- 
tial magnetization b to the degeneracy parameter fi. We 
note this function b e (fi). It is represented in Fig. [10] for a 
particular value of the energy (see below). According to 
the stability diagram of Fig. [7] the homogeneous Lynden- 
Bcll distribution is stable for any value of the degeneracy 
parameter if e > 1. On the other hand, it is always unsta- 
ble (i.e., it is not a maximum entropy state) if e < 1/3. 
Finally, if 1/3 < e < 1, the homogeneous phase is stable 
only for p min (e) < M < n C nt{e) where Ai mm (e) = l/\/Qe. 
Using the curve b e (fi), we can express this stability crite- 
rion in terms of the initial magnetization. We first note 
that A9 e [0, 1] so that < x < n. On the other hand, 
for x = 7r, we find that 6 = and e = (try) 2 /6 leading 
to n = l/\/6e = (immff). Therefore, if 1/3 < e < 1, the 
homogeneous phase is stable only for < b < b cr it(e) 
where b cr it(e) — b e (p cr i t ). Above the critical magnetiza- 
tion b cr n (e) , the homogeneous Lynden-Bell distribution is 
not a maximum entropy state (it is a saddle point). 
Using the notations of [26], we have 



X{l '-\ 



b = M x . 



(80) 



As in [2B], we fix an energy U = 0.69. In our notations, 
it corresponds to e = 0.76. From Fig. we find that the 
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Fig. 10. Initial magnetization b — M x as a function of the 
degeneracy parameter /j, for a given value of the energy. There 
exists a critical magnetization, corresponding to /i cr it(e), above 
which the homogeneous Lynden-Bell distribution is unstable. 



critical degeneracy parameter corresponding to this en- 
ergy is n cr u — 1.043.... The homogeneous phase is stable 
for 0.468 < n < 1.043. Using the relation between /j, and 
the initial magnetization b — M x for U = 0.69 represented 
in Fig. [TO] we conclude that the homogeneous Lynden- 
Bell distribution is stable (maximum entropy state) for 
M x < 0.897. Above this critical value, it is not a maximum 
entropy state so it should not result from a complete vio- 
lent relaxation: (i) because it is not the most mixed state 
(ii) because this distribution is dynamically unstable with 
respect to the Vlasov equation. The existence of a critical 
magnetization is natural. Indeed, for M x — > 1, the degen- 
eracy parameter /i — > +oo. Since the Lynden-Bell distribu- 
tion becomes "non-degenerate" in this limit, the stability 
criterion is U > U c = 3/4 as for the Maxwell-Boltzmann 
distribution. Since U = 0.69 < U c in the simulations, 
there should exist a critical magnetization M x ^ cr i t above 
which the system becomes unstable. In fact, we already 
know that the homogeneous Maxwell-Boltzmann distri- 
bution is not always a maximum entropy state. Since this 
is a particular limit of the Lynden-Bell distribution, it is 
expected that the homogeneous Lynden-Bell distribution 
itself is not always a maximum entropy state. 

If we consider the inhomogeneous Lynden-Bell distri- 
bution ([9]) and assume, without loss of generality, that it 
is symmetric with respect to 9 = (chosen as the ori- 
gin), the mass, the magnetization and the energy can be 
expressed as 



M 



B 



<K) 



P 



1/2 



7_i/ 2 (Ae 



0B cos e 



)d6, (81) 



kM J^ /-i /2 (Ae^ Bcose ) cos9d9 



2tt 



1-2 TT 



^I_ 1/2 {\eP B ™e)d9 



(82) 
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E 



2 m V/3 



3/2 r 27T 



J I 1/2 (Xe^- s )dO-^, (83) 



where we have used <P — BcosO. Equations (|8Tf - ([83]) de- 
termine the equilibrium magnetization B as a function of 
the temperature T or energy E for a given value of the 
degeneracy parameter fi. The homogeneous state B = is 
always a solution of these equations and we recover Eqs. 
f29] ) -([3"g] ) . On the other hand, in the dilute limit A -> +oo, 
using the expansion (f2TT) . Eq. ([82]) reduces to the implicit 
equation (25) of [12 for the Maxwell-Boltzmann distribu- 
tion. To determine the critical temperature at which the 
inhomogeneous solution appears, we expand the equations 
([8l"]) - (l82]) for B — > as discussed in [12] at a more general 
level. This yields 



B = - — ^B{3B[l + J(X)({3Bf 



4tt I_i /2 (A) 



where 



„. 1 3AJ" A 2 /'" A/' A 2 /" 

J(A) = - H 1 . 

y ' 8 8/' 8/' M 4 1 



(84) 



(85) 



and we have noted I for 7_ 1 / 2 (A). It can be shown that 
J(A) is always negative with J(0) = (Fermi) and J(+oo) = 
-1/8 (Maxwell). Therefore, Eq. (J83J will have a solution 
B y^ if, and only, if 



fcM AIj 1/2 (A) 

4^ Z-i/2 (A) 



/3>1. 



(86) 



This is precisely the condition ([38]) giving the point at 
which the homogeneous phase becomes unstable (i.e. be- 
comes a saddle point of entropy). Therefore, in continuity 
with the Maxwell-Boltzmann distribution (see, e.g., [32]), 
the inhomogeneous Lynden-Bell phase appears precisely 
when the homogeneous Lynden-Bell phase becomes un- 
stable. This result is in fact quite general as discussed in 
Sec. 4.3 of [12]. For the Maxwell-Boltzmann distribution, 
it has been shown in [12j by an explicit calculation (solving 
an eigenvalue equation associated with the second order 
variations of entropy) or by using the Poincare argument 
for linear series of equilibria that the inhomogeneous dis- 
tribution, when it exists, is always a maximum entropy 
state. By continuity, we expect in the present case that 
the inhomogeneous Lynden-Bell distribution is a maxi- 
mum entropy state for the functional ((J) . Therefore, in the 
situation considered in [26] , the homogeneous Lynden-Bell 
distribution is a maximum entropy state for M x < 0.897 
and it becomes an unstable saddle point above this criti- 
cal magnetization. For M x > 0.897 the maximum entropy 
state is an inhomogeneous Lynden-Bell distribution. 

The existence of a critical initial magnetization is in- 
teresting because there has been recent claims, based on 
numerical simulations, that the dynamics should be differ- 
ent for small (MO) and large (Ml) magnetizations [8]. Our 
theoretical study gives further support to that claim. For 
M x < 0.897, our study based on the statistical mechanics 
of violent relaxation predicts that the system should tend 



to an homogeneous Lynden-Bell distribution with gaus- 
sian tails. This is confirmed by the numerical work of An- 
toniazzi et al. [26j who show simulations up to M x = 0.7. 
In that case, all the results can be explained by standard 
statistical mechanics and kinetic theory |10I12I16I23I42I43"] . 
However, for M x > 0.897, the situation is different. The 
statistical mechanics of violent relaxation predicts that 
the system should tend to an inhomogeneous Lynden-Bell 
distribution (most mixed). The occurence of a change of 
regime (dynamical phase transition) seems to be consis- 
tent with numerical results of Pluchino et al. [SJ who ob- 
serve the appearance of structures in the /^-space for large 
initial magnetization (but not for small). The fact that 
M XiCr it = 0.897 is close to one is also in qualitative agree- 
ment with recent reports of Pluchino & Rapisarda |44j . 
When the system becomes spatially inhomogeneous or in- 
volves phase space structures, the statistical mechanics 
and kinetic theory become complicated and may lead to 
anomalies as mentioned in [T7]- For M x > 0.897, since the 
dynamics becomes more complex, it is possible that the 
system will not mix well during violent relaxation so that 
the inhomogeneous Lynden-Bell distribution (most mixed 
state) will not be achieved in practice. This is in fact what 
is observed. Indeed, for M x = 1, the degeneracy parameter 
/i — ► +oo so that the Lynden-Bell distribution coincides 
with the Maxwell-Boltzmann distribution (non degener- 
ate limit). Now, for M x = 1 the QSS is not a gaussian as 
shown in [6]. Thus, we expect that for M x > 0.897 the sys- 
tem will be trapped in an incompletely mixed state (which 
may be spatially homogeneous or weakly inhomogeneous) . 
This is a stable stationary solution of the Vlasov equa- 
tion but different from the Lynden-Bell distribution due 
to incomplete relaxation. Numerical simulations 6J show 
that, in certain cases, this state can be fitted by a Tsal- 
lis distribution. The Tsallis distributions form a particular 
one-parameter family of stationary solutions of the Vlasov 
equation (indexed by q) known as stellar polytropes in 
astrophysics |33|37| . However, there is absolutely no fun- 
damental reason why the Tsallis distributions should be 
selected in a universal manner as a result of incomplete 
violent relaxation [33 25]. Other fits can work as well or 
even better (see, e.g., [IT]) depending on the situation. 
In fact, any distribution function of the form / = /(e) 
where e = v 2 /2 + <P is the individual energy (<P = for 
a homogeneous system) is a steady state of the Vlasov 
equation. Furthermore, if /(e) maximizes an H-function 
H = — J C(f)d9dv (where C is convex) at fixed mass M 
and energy E, then it is nonlinearly dynamically stable 
with respect to the Vlasov equation [12] ■ Tsallis distribu- 
tions associated with C(f) = (l/(q — 1))(/ 9 — /) are a 
special case of distribution functions enjoying these prop- 
erties but infinitely many other distributions can be con- 
sidered as well. The non-universality of the distribution 
function of the QSS, depending on the dynamics, is fur- 
ther discussed in the Conclusion and in [55] . Although the 
Tsallis distributions have not a fundamental justification 
in the context of incomplete violent relaxation, an inter- 
est of these distributions is their mathematical simplicity 
and this is why it is convenient to try this fit first. Such 
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fits have indeed been considered in [6] and the best fit 
is obtained for q* = 7 Q It gives a reasonable, but not 
perfect, agreement with observations. As said previously, 
there is no fundamental reason why the QSS should be 
precisely described by a Tsallis distribution, so the devi- 
ation between observation and fit should not cause sur- 
prise. In our opinion, the detailed structure of the QSS 
is unpredictable in case of incomplete violent relaxation 
(see Conclusion and [25]). This unpredictability is already 
present in the Tsallis q parameter which is a free param- 
eter which has to be adjusted to the situation in order to 
fit the results at best. More generally, we argue that the 
pdf of the QSS should not always be a Tsallis distribu- 
tion, even in case of incomplete relaxation (i.e. when the 
Lynden-Bell prediction fails). More general distributions 
could arise [33 37 25. However, the Tsallis formalism is 
nice because it provides simple analytical expressions of 
non-standard distributions (with one single parameter q) 
that can be handled easily (hence its popularity!). Fur- 
thermore, an effective kinetic theory, based on generalized 
Fokkcr-Planck equations, can be developed in consistency 
with these distributions 45 46J. Although more general 
kinetic theories can be developed as well for other equilib- 
rium distributions associated with other forms of "general- 
ized entropies" [33147) , the g-Fokker-Planck equations as- 
sociated with the Tsallis entropy provide a good basis for 
practical studies (due, again, to their simplicity) and they 
may be representative of more general situations. As sug- 
gested in |47|31|23j . these effective kinetic theories could 
be useful precisely when standard kinetic theories break 
down or become complicated [17j due to the emergence 
of structures in /i-space, non-ergodicity, memory effects, 
finite N effects etc. Of course, when standard kinetic the- 
ory applies |10|12|16|23|42|43j . they are not necessary. A 
plausible scenario is that standard statistical mechanics 
(based, however, on Lynden-Bell's approach) applies for 
M x < 0.897 and that anomalies appear for M x > 0.897 
because the evolution is non-ergodic and involves phase- 
space structures, memory effects etc. It is in this regime 
that Tsallis effective thermodynamics (or more general ap- 
proaches [33147] ) could be applied. Therefore, our study 



3 The nonlinear dynamical stability of the homogeneous 
Tsallis distributions (polytropes) can be studied using the re- 
sults of [12] (independently, an equivalent calculation has been 
made in parallel in |11|). The q* of [5] is related to our q in [T2] 
by 1 — q» — q—1 hence q — 2 — q, = ~ 5. This corresponds to a 
polytropic index n = 1/2 + l/(q — 1) = 1/3 or 7 = 1 + 1/n = 4. 
Our study in [T2] shows that such DF are nonlinearly dynam- 
ically stable with respect to the Vlasov equation (they maxi- 
mize the Tsallis iif-function [37] at fixed mass and energy) if 
e > e crit = l/ 7 = 1/4 hence U > 9/16 = 0.5625 which is 
fulfilled for U = 0.69. By contrast, the homogeneous Maxwell- 
Boltzmann distribution (q = 1) is stable for U > 3/4 which is 
not fulfilled. Therefore, the homogenenous Tsallis distribution 
with q, — 7 is stable while the homogeneous Lynden-Bell dis- 
tribution (equivalent to the Maxwell-Boltzmann distribution 
in the dilute limit M x — 1, fx — > +00) is unstable. Note, finally, 
that the critical energy e cr u = 1/7 obtained in [12] is equiva- 
lent to the critical energy U cr it — 3/4 + (g, — l)/(2(5 — 3q*)) 
obtained in [11] but expressed in a simpler form. 



tends to reconcile two groups of researchers by suggesting 
that they study two different dynamics, below |26] and 
above [8] the critical initial magnetization M x — 0.897 
(for U — 0.69). This is consistent with our general claim 
[33147137131(215125] that the Tsallis formalism can be use- 
ful in some situations even if it provides, in our opinion, 
only an effective description of complex systems. Things 
are more complex than often said and they deserve a de- 
tailed and careful discussion. 



7 Conclusion 

In this paper, we have investigated the stability of the 
spatially homogeneous Lynden-Bell distribution ([26]) by 
determining whether it corresponds to a maximum of the 
functional ([4]) at fixed mass and energy. This maximiza- 
tion problem provides a condition of thcrmodynamical 
stability for the process of violent relaxation (in which 
case S is interpreted as an entropy) as well as a condi- 
tion of nonlinear dynamical stability with respect to the 
Vlasov equation (in which case S is interpreted as a gener- 
alized ii- function in the sense of [36j). The thermodynam- 
ical stability condition ensures that the system is the most 
mixed state with respect to microscopic (fine-grained) per- 
turbations. The nonlinear dynamical stability condition 
ensures that the coarse-grained distribution is robust for 
the collisionless dynamics against macroscopic perturba- 
tions. It is particularly interesting to note that the con- 
ditions of thcrmodynamical (in Lynden-Bell's sense) and 
nonlinear dynamical stability coincide. We have obtained 
the expression of the critical energy and critical tempera- 
ture above which the homogeneous phase is stable as a 
function of the degeneracy parameter. The known sta- 
bility criteria corresponding to the Maxwell-Boltzmann 
distribution and the water-bag distribution are recovered 
as particular limits of our study. Furthermore, a critical 
point /i* = 0.68786... has been found below which the ho- 
mogeneous phase is always stable, whatever the value of 
energy and temperature. When the homogeneous Lynden- 
Bell distribution is unstable (saddle point of entropy) it 
cannot be achieved as a result of violent relaxation. In that 
case, the maximum entropy state is an inhomogeneous 
Lynden-Bell distribution. For a given value of energy, the 
transition should occur for a sufficiently large value of the 
initial magnetization (M x > 0.897 for U = 0.69). We 
have suggested that the relaxation becomes incomplete 
for M x > 0.897 so that the Lynden-Bell prediction fails 
(this should be checked numerically but this seems to be 
the case at least for M x = 1 [6 ]). In that case, other distri- 
butions, that are stable stationary solutions of the Vlasov 
equation, can emerge. In some situations, the QSS can be 
fitted by the Tsallis distribution (poly trope). This provide 
a simple characterisation of the QSS but this fit is not ex- 
pected to be universal or fundamental. The fact that the 
Lynden-Bell prediction breaks down is the mark of a lack 
of ergodicity and a lack of efficient mixing. Dynamical 
anomalies then appear and the Tsallis formalism could be 
used in that context (as an effective description) as con- 
sidered in [6]. Thus, having evidenced a new dynamical 
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phase transition, our study may reconcile two groups of 
researchers by showing that they describe in fact differ- 
ent dynamical processes: for M x < 0.897 the dynamics is 
ergodic and ordinary statistical mechanics (Lynden-Bell 
[2"T] ) applies and for M x > 0.897 the dynamics is non- 
ergodic and effective generalized thermodynamics, such as 
Tsallis [24 approach (or more general |33|47j approaches) 
could be tried. 

We would like to conclude this study by emphasizing 
the limitations of the Lynden-Bell statistical theory at a 
general level. First of all, the distribution function © is 
only valid when the initial condition takes two values 
and T/o- Therefore, it is not expected to apply to any ini- 
tial condition. For more complex initial conditions, the 
Lynden-Bell prediction is a superposition of Fermi-Dirac 
distributions for all the phase levels n. Therefore, depend- 
ing on the initial conditions, the Lynden-Bell distribution 
can take a wide diversity of forms given by the general for- 
mula Q12[) : this is similar to a sort of superstatistics [3T] 
where x(v) is fixed by the initial condition. The Fermi- 
Dirac distribution ((9]) is just a particular case of this gen- 
eral formula for two levels. It is indeed important to stress 
that the prediction of Lynden-Bell depends on the details 
of the initial condition, not only on the robust conserved 
quantities E and M. This is at variance with usual statis- 
tical mechanics where only the robust contraints (energy, 
mass,...) matter. This is due to the existence of Casimir 
contraints in the Vlasov dynamics that act as hidden con- 
straints |31j . When we consider realistic initial conditions, 
we enter into complications because: (1) we need to dis- 
cretize the initial condition into several levels and then 
relate the Lagrange multipliers xi 7 !) to the hypervolume 
7(77) of each level [28I31J . This makes the application of 
the Lynden-Bell theory technically complicated and heavy 
because it involves a lot of control parameters [48] . (2) we 
do not always know at which scale we must discretize the 
initial condition and different discretizations may lead to 
different results as discussed in [49] (p. 284) and in [50] . 
(3) in addition, there is a debate to decide whether all the 
Casimirs are conserved (microscopically) or if certain are 
altered by non-ideal effects during the dynamics so that 
a prior distribution should be introduced instead (this re- 
mark applies particularly to realistic systems such as 2D 
turbulence 51 33 52 53 54J). The simple two-levels situa- 
tion considered in Antoniazzi et al. [26j is not subject to 
such difficulties and criticisms. 

On the other hand, the approach of Lynden-Bell as- 
sumes that the system mixes well so that the hypothesis 
of ergodicity |f| which sustains his statistical theory (max- 
imization of the entropy) is fulfilled. Again, this is not 
expected to be general. Several cases of incomplete vio- 
lent relaxation have been identified in stellar dynamics 



and 2D turbulence (see some references in 25 i). In such 
cases, the QSS is not exactly described by the Lynden- 
Bell distribution but it is nevertheless a stable stationary 
solution of the Vlasov equation. Therefore, distributions 
different from ^ can emerge in case of incomplete violent 
relaxation. This is the case for example in the plasma ex- 
periment of Huang & Driscoll [55] in 2D turbulence where 
it has been observed that the QSS is not perfectly well- 
described by the Lynden-Bell theory. In particular, the 
density drops to zero at a finite distance instead of decay- 
ing smoothly. Boghosian [56 has interpreted this result in 
terms of Tsallis non-extensive thermodynamics. Alterna- 
tively, the deviation from the Lynden-Bell prediction has 
been interpreted in 4Sj as a result of an incomplete vi- 
olent relaxation (non-ergodicity) and a lack of mixing in 
the core and the halo of the "vortex" . In this interpreta- 
tion, the QSS is viewed as a particular stable stationary 
solution of the 2D Euler equation which is not the most 
mixed state. As we understand, the proposal of Tsallis is 
to introduce an entropy which can take into account non- 
ergodic behaviours 0. Indeed, generalized entropies make 
sense only when the system is non ergodic. If the sys- 
tem mixes well, as in the situations considered in [26], 
the Lynden-Bell theory is the relevant one [25 j . Unfortu- 
nately, we do not know a priori whether the system will 
mix well or not; this depends on the dynamics and on 
the route to equilibrium [25] , We only know a posteriori 
if the Lynden-Bell prediction has worked or failed (like 
in, e.g., [55]). The possibility that non-ergodic behaviours 
could be described by a generalized form of entropy is an 
attractive idea. However, we do not believe that compli- 
cated non-ergodic behaviours associated with the process 
of incomplete violent relaxation can be encapsulated in a 
simple functional such as the (/-entropy proposed by Tsal- 
lis. When the system does not mix well we can have a wide 
variety of QSS. This is because the Vlasov (or 2D Euler) 
equation admits an infinite number of steady states and 
the system can be trapped in one of them. A kinetic the- 
ory of violent relaxation, as initiated in [28I57J . is then 
necessary to account for incomplete relaxation (see |25j). 
In conclusion, for these two reasons: (1) dependence 
on the detailed structure of the initial conditions (through 
the Casimirs constraints) (2) incomplete violent relaxation 
(non ergodicity), the QSS is not expected to be described 
by a "universal" distribution such as ((26]) . or even (fT2]) . 
However, as claimed long ago in [IS], the Lynden-Bell 
theory is the only one to make a prediction of the QSS 
without ad hoc parameter. It is usually observed that the 
Lynden-Bell prediction provides a fair description of the 
QSS in many cases even if there can exist discrepencies 
that are more or less pronounced due to incomplete relax- 
ation. Thus, the Lynden-Bell distribution gives the ten- 



4 It should be clear that, in this paper, we are talking about 
the ergodicity with respect to the collisionless mixing in rela- 
tion with the process of violent relaxation, not the ergodicity 
with respect to the collisional evolution. Collisional relaxation 
(due to granularities and finite TV effects) is not considered here 
because it occurs on very long timescales for TV ^> 1 and does 
not account for the structure of the QSS [12] , 



In this respect, we should stress that the proper form of 
Tsallis entropy for the process of violent relaxation is the one 
given in [25| . expressed in terms of p(8,v,n). In the two-levels 
approximation, it reduces to a q- Fermi-Dirac type entropy |48| . 
Within this interpretation, the index q would be a measure of 
mixing. For q = 1 (efficient mixing), we recover the Lynden- 
Bell theory (see [25]). 
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dency to which state the system should tend as a result of 
mixing. However, during the route to equilibrium, mixing 
may not be sufficient and the system can be frozen in a 
stationary solution of the Vlasov equation which is not the 
most mixed state. This process of incomplete relaxation is 
beautifully described by Binney & Tremaine 34J, pp. 266- 
267, using an analogy with the structure of the Mississippi 
river. On the other hand, Tsallis distributions form just 
a particular one-parameter family of stationary solutions 
of the Vlasov equation (analogous to stellar polytropes) 
that can sometimes be used as convenient fits, in case of 
incomplete violent relaxation, due to their simple math- 
ematical expression. However, these fits should not work 
in a universal manner and other fits can work as well, or 
even better. 

There are still debates and controversies about the fact 
that the collisionless evolution of the HMF model is ade- 
quately described by the Vlasov equation. Indeed, the au- 
thors of [6|8|15j describe the QSS in terms of Tsallis gen- 
eralized thermodynamics based on the V-body system, 
not in terms of the Lynden-Bell thermodynamics based 
on the Vlasov equation. The Vlasov description is clas- 
sical in plasma physics and astrophysics (as well as in 
point vortex dynamics and 2D turbulence where it has 
the form of the Euler equation [55]) to describe the evolu- 
tion of the system during the regime where "collisions" are 
negligible. In that case, there are no correlations between 
the particles and the ./V-body distribution function is a 
product of N one-body distribution functions. Using this 
property to close the BBGKY hierarchy steming from the 
Liouville equation, one obtains the Vlasov equation [2"5] . 
For a system with weak long-range interactions, it can 
be shown that this mean field description is correct in a 
proper thermodynamic limit N — > +oo |£|. A mathemati- 
cally rigorous derivation of the Vlasov equation is given 
by Braun & Hepp [53]. However, justifying the Vlasov 
equation for the collisionless regime of the HMF model 
is not the end of the story. As noted in [25], the Vlasov 
equation coupled to a long-range force can have a very 
complicated behaviour (this is similar to the Euler equa- 
tion in 2D turbulence [22]). Therefore, the anomalies (non- 
ergodicity, phase space structures,...) observed by [6I8I15J 
in their V-body simulations would probably persist and 
be observed by directly solving the Vlasov equation. This 
would describe the N — ► +oo limit of the model. This com- 
parative study (V-body Hamilton equations versus Vlasov 
equation) has not yet been done for the HMF model but 
it would be an interesting step to reconcile different ap- 
proaches. It would also clearly show whether the "anoma- 
lies" reported in 6 8 T5] are due to finite V effects or if 
they persist in the thermodynamic limit V — > +oo. 



6 As shown in 16 12 23 , the Vlasov equation also describes 
the collisional relaxation at order 1/V. This is because the 
Lenard-Balescu collision term cancels out for ID systems (this 
property is known for a long time in plasma physics [58|). Col- 
lisions therefore manifest themselves on a timescale larger than 
N. For the HMF model, numerical simulations show that the 
relaxation time scales as N 1 ' 7 [9]. 



Note finaly that, since the Lynden-Bell distribution ([9]) 
is similar to the Fermi-Dirac statistics in quantum me- 
chanics, the results of this paper also describe the (ordi- 
nary) statistical mechanics of a system of V fermions on a 
ring interacting via a cosine potential; this could be called 
the fermionic HMF model. In that context, the maximum 
value of the distribution function is 770 = g/h where h is 
the Planck constant and g = 2s + 1 the spin multiplic- 
ity of the quantum states. In this quantum context, r/o is 
fixed by the Pauli exclusion principle (see the analogous 
situation for self-gravitating fermions in [60 ). 
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